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Introduction 

In the Improving Teaching Competencies Program at the Northwest 

Regional Educational Laboratory wfe have been developing fifteen sets of 

training materials to be used in organizational improvement strategies . 

1 2 

with public schools. * The individual effectiveness of ten of the systems 

3 

which have been completed has been determined. Individual effectiveness 
of the five still being completed as ouxl program finishes this year has 

begun to appear evident. A developmental model of how organizations may 

1 4,5 
change and evolve has been conceptualized and proposed in this program. 9 

/ 

The sets of training materials have only begun to be used in 
combinations as part of organizational development strategies. Earlier, 
they tended , to be used 'by colleges or school districts for inservice 
training workshops on an occasional basis- More recently, combinations 
have been used for facilitating racial integration efforts such afe^n the 

inneapolis, Minnesota, schools, to prepare internal cadres of training 
consultants in Portland, Oregon, and Seattle, Washington, to provide a 
core of experiential learnings for advanced degree programs such as in 



the Fairfax County, Virginia, schools, to further the expertise and 
visibility of over five hundred professionals dpipl training and 
consulting in schools, and in some cases, as an explicit effort to 
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increase self renewing functional capabilities of particular organization 
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As these materials become used in combinations for alternative 
strategies, studies of educational change become more possible and more 
necessary. These training packages may make large scale system interven- 
tions more feasible and easier to control and document. They raise a new 
round of issues and questions for both practice and research. 

This paper will present a description of -some of the needs which 
seemed apparent in the mid 1960's which generated the efforts to create 
these training materials and support training of trainers, the issues at 
that time which seemed to need answers, a number of actions which have 
be6n taken, answers found for some of the issues, and suggestions of 
work yet to be done. ^ ^ 

Some Apparent Needs in 1966 

A sizeable body of literature was generated out of the 1960's and 

into the 1970 f s concerning shortcomings in our system of public education 

6 7 8 9 10 

and needs for improvement. » »■ » » At that time, the author was involved 

I— 

in the Cooperative Project for Educational Development (COPED) which 
sought to study models of planned change for educational improvement. 
COPED was a consortium of eight universities** and about twenty-five < 
•chool districts coordinated by the National Training Laboratories — 
Institute for Applied Behavioral Science. Massive amounts of system 
level data were collected and large scale interventions were initiated.. 
Funding was postponed between the second and thircK^ears of the intended 
three years of the COPED project ending the change interventions and 
disrupting the data collection and processing. 
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Nevertheless, COPED provided some prototype intervention strategies, 

temporary linkages between schools and universities, lasting collegi3l bonds 

among individuals, training experiences for both school district and 

university personnel, and improvement of some methodology f or^ both 

14 

research and local diagnostic uses. 

COPED also provided insights as to some apparent* needs if progress 
*fcere to be made at the level of discovering ways to study and to improve 
educational organizations. Major among these were apparent , needs for: 
1) explicated models of how educational organizations function and may 
change; 2) training systems that could be used more widely and economically 
to improve organizational functioning; 3) training consultants With 
intermediate levels of knowledge and skills, locally based or available 
'to link, with the comparatively few social science experts in this field; 
and, 4) improved, methodology for research, diagnostic and evaluation purposes. 

The outcomes of the COPED effort were greatly restricted by these needs. 
Models of planned change and efforts to study them were limited by the s 
state of the art. As one COPED staff member said to a critical U. S. Off/Ice 
of Education review panel member, "You thought we were working with a 
bulldozer, but now you've discovered that all we have are shovels and 
wheelbarrows." jThe author of this papej became convinced, continuing with 
another analogy, that some new kindS of bricks aod mortar had to be created 
before alternative types of structures could be built and their comparative' 
applications studied. 
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Some Issues that Needed Answers 

The four apparent needs identified from the COPED project generated 
a set of issues needing answers. Organizational theory and research up 
to that time indicated that organizational improvement would need to 
involve changed functioning of communications, influence, decision 
making, 15 and various forms of "problem solving adequacy." 16 It was 
presumed that improvement of these functions would often be needed to 
support improvements of structure, instructional functions and learner 
behaviors. 17 The kind of dynamic models of organizational functioning 
being explored in industry 18 were needed appropriate to the unique aspects 

of educational systems. 

Training for educational personnel in such areas was expensive. 
It generally involved high priced individuals who were experts in the 
substance of what was J;o be learned as well as ways to provide "process" 
training experiences. There were few behavioral scientists with such 
combined expertise. The training designs they used, and limited avail- 
ability of training materials, generally limited them to working with 
small groups at a time. { 

The following were some of the major issues that needed answers: 

1. Could effective training in interpersonal skills and different 
kinds of problem solving be provided using packages of materials 
with designs conducted by non-experts? 

2. Could such an' approach be made attractive enough in terms of 
interesftand enjoyment in the training experience, and reasonabl 
enough in terms oE cost in dollars and time, - so that* large nurobe 
of educators would take this training 



3. Would those who provide' and implement such training accept 
and.us,e these training packages? Would they be acceptable 
for credit by degree granting, institutions? Would schools 
use them for* inservice education? 

4. Could such training resources be extended to increase the 
nitober of trainers with intermediary and advanced capabilities 
for improving organizations? That is, could packaged training 
systems be developed to help in training trainers beyond the u 
general systems for interpersonal skills and kinds of problem 
solving? 

5. Could a staff developing such training resources contribute to 
conceptualizing dynamic models that offered resolution of some 
ef the disagreements that were current? Such disagreements 

- involved differences in problem solving orieptations as well 
'as philosophic assumptions about the nature of people and of 
organizations. Without some progress. in synthesizing, or at 
least clarifying, some issues, apparent conflicts between forms 
of training seemed potentially confusing or destructive. 

6. Could methodology be identified or created to adequately evaluate 
efforts to develop training resources and train trainers? 

If so, it might offer added resources both to research and 
diagnoses of local change efforts. 
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Some Actions Taken 

In 1967 the Improving Teaching Competencies Program of the Northwest 
Regional Educational Laboratory (NREL) was developing four sets of training 
materials (they eventually were labeled instructional systems) focused on 
pupil-teacher interactional concepts and skills. These included versions 
of Flander's "Interaction Analysis," 19 Taba's "Higher Level Thinking 
Abilities," 20 Suchman's "Facilitating Inquiry," and Cogen's clinical 

22 

supervision labeled, "Systematic and Objective Analysis of Instruction."" 
From 1968 through 1975, the program wag expanded to include packaged 
training systems concerned with: 1) 'the role of being a learner; 2) three 
different kinds of, problem solving; 3) interpersonal skills; and 4) training 
trainers for skills training, consulting and organizational development. 
Diagram I gives the titles of these systems. They are described in the 
literature 1 and in materials available from the NREL. Approximately 
five million dollars will have been spent on this program by its conclusion 
in November of 1975. The program efforts have been primarily in materials 
creation, field trials and evaluation, building field relationships, 
public relations, work with publishers, and political concerns, especially 

for federal funders. . 

A clarification was identified and proposed concerning the differences 
between, and- relationships among, three kinds of logical problem solving. 
'The basic conception was presented in a paper at the 1971 AERA Convention. 
It is proposed that technical issues call for some type of system technology, 
theoretical issues occurring in field settings call for a version enaction 
research, and social conflict issues raise a need for negotiative ca;vibil:t:. 
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Much continuing confusion and difficulty in education, as well as other 

areas of society, seems related to lack of skills in each of these kinds 

of problem solving^and differentiation among them. We have worked on 

training systems for each of the three . They are "System Approach for 

23 

Education 11 (SAFE: with R. E. Corrigan, Associates), "Research 
Utilizing Problem Solving'\(RUPS) , 24 and "Social Conflict and Negotiative 
Problem Solving." 25 

While each problem solving system involves its own techniques for 
problem identification and needs sensing, it appears that * generic model 
of needs assessment is much needed which* would include a clarification of 
which of these three kinds of problem solving is central for a given issue 
Only through such clarification are the appropriate criteria for decision 

(7 

making in problem solving efforts likely to be applied. Clarity could 
also allow the relation of applications of each kind of problem solving 
to be kept straight as one moves back and forth between them^during an 
improvement project. 1 

i 

Eight training packages from the program are conceived as providing 
a sequence of learning experiences to prepare individuals and involve 
them in organizational development work in educational institutions. 
These include the three for the different ty#s of problem solving, two 
which focus on interpersonal skills labeled, "Interpersonal Communications, 
"Interpersonal Influence," 27 and a trio with the overall title, "Preparing 

?g 

Education Training Consultants" (PETC) including "PETC I: Skills Training, "~ 

30 

"PETC II: Consulting," 29 and "PETC III: Organization Development." 
Diagram II gives theit*'recommended order of use and some brief information 

• y 

about each. 
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DIAGRAM II 
RELATIONSHIP OF THE THREE PETC SYSTEMS 



PETC-l: 

Skills Trslning 



Individual or 
■mail group 



To increase 
process skills 
such ss goal 
setting, 
communicating, 
influencing or 
decision making 



PETC-II: 
Consulting 



Small group or 
major subsystem 
of the 

organisation 



PETC-III: 

Organizational 

Development 



The organization (although most of the 
work may be with a major subsystem) 



S 



I 



To move through 
phases of sn 
improvement 
effort 



Usual Duration 
of the Client 
Relationship 



Prerequisite 
Competencies 



Magnosis for, 
And provision of, 
group process 
jbkllls training 
exercises 



A -few hours 
or days 



Trainer 
Experience In: 

Action 
teeearch 

(RUPS) 

Interpersonal 
Communications 

(IPCL 



Differential 
diagnosis and 
intervention to 
provide added 
functions in a 
temporary 
relationship 



To add and maintain improved functional 
capability 

To increase those functional capabilities 
that enable the organization to add 
new kinds of objectives or use new 
kinds of resources 



Application of diagnostic and intervention 
techniques to facilitate normative and 
structural changes in the organization 
which a) maintain improved functions and 
b) make its Identity and decision-making 
dynamic in response to social change 



A few days 
or weeks 



Several months to four or five years 



PETC-I 

Interpersonal 
Influence (INF) 



PET^H 

System Technology 

Conflict and Negotiations in Education 
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An initial conception of the relation of packaged training materials 
and training of trainers was proposed in a position paper presented to 
the Natiortal Training Laboratories and at an invitational conference at 
the Western Behavioral Sciences Institute in 1968. Diagram III presents 
the general schema of that conceptualization. It was furthered, among 
other sources by ideas generated at Ronald Havelock's "Conference on 
Educational Change Agent Training," 31 which the author helped design 
and chaired. 

A major synthesizing element was derived by borrowing from developmental . 
models of individual human growth and proposing their application to 
organizations' It appeared to the author that many organizational develop- 
ment efforts ran into trouble, not so much because of the substantive issues 
which consultants tend to infer, but because the- form of innovations being 
introduced were out of phase with the "maturity" of the organization. 
In addition to models of planned change, organizational health, differential 
diagnosis, differential intervention, and organizational, growth, the PETC III 
materials introduce a model of organizational maturity. Whereas growth is 
defined as balance and strength of functions in relation to an organization's 
purpose, maturity is defined as the characteristic ways in which sixteen 
presumed key functions occur in an organization. This opens a whole set 
of dimensions for entry, work and closure with an organization. Diagram IV 
presents descriptions of functions in each of four phases of maturity. 
It, and Diagram V indicating predictive guidelines for the intervening 
consultant, are taken out of context from the PETC III materials. 
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The area of individual maturity and personal growth seems vitally 
related to this type of conception of organizations. It raises many 
questions. For example: Can an organization increase the maturity of 
its functions beyond the maturity level of individuals in key influence 
positions? Does work on personal growth need to precede the introduction 
of certain forms of functional procedures? What types of leadership 
interventions versus norm building might be necessary to introduce certain 
forms of functions? Do some kinds of advanced functions facilitate 
individual movement in such maturity dimensions as Piagetian cognitive 
growth, Kohlberg's moral growth, or L^evinger's ego development? How can 
communication problems be coped with when they involve people at different 
levels of developmental maturity such that at least one, by definition, 
lacks the meanings of the other on an issue? Since educational organizations 
-treed be concerned wi t h s uc h issues ^ of g rowth an4~developmeo4^ in terms of 



ERLC 



their central purpose, such questions seem to the. author to be especially 

relevant for those who would seek to improve our schools. 

One effort in our materials development program has sought to provide 

a personal gr6wth experience concerned with recognizing and supporting the 

ownership of behavior. It is based on research and theory of linguists 

such as Chomsky and the interpersonal theory of psychotherapy of Harry 

Stack Sullivan. Using many concepts of the Sagans, Jean Butroan and 

Fred Newton conducted some pioneering work in creating a system titled, 

31 

"Teaching Responsively for Individualized Meaning" (TRIM). It involved 
the most innovative and controversial of the program's evaluation efforts. 
Personal growth training is seen as different from organizational efforts 
in the Program. It may well need to be essentially related in a particular 

17 
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organizational development strategy. Our experience has-been that the 
personal growth area scares the Hell out of our federal funders and is 
at least widely misconceived by most empiricists we have encountered. 
To be fair, it seems that misconceptions are nearly as often found the 
other way. If the two do really need to be frequently related in 
particular strategies, then priority must be given to incorporating 
and finding ways to use resistances of persons who hold such biases. 
The author acknowledges that they may sometimes be based in philosophical 
differences, but suspects they are more often a matter of individual 
maturity and cultural deprivation. 

Outside of the work done on TRIM, evaluation in the program has been 
fairly conventional. It has been difficult to find appropriate 
instrumentation. Some creative work has been done which may prove a 
-eairtrtfaoL l ui i t o the f^ld^-a^ul-aLjlJ^eJl^^dif ferent session at this 
years AERA convention is being devoted to several reports on^tfcii^ 



It may be worth noting that during earlier years in the regional laboratory^ 

setting we were constrained from using too many resources in research-like 
r 

behavior. This eventually switched to criticism demanding more evaluation 
accompanied by great pressure for more conventional kinds of evaluation. 
In some ways, we are experiencing the greatest flexibility as we end the 
program atka time when the climate in education is such that everyone 
seems afraid to demand anything. < 
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Answers for Some of the Issues 

From the actions of the Improving Teaching Competencies Program 
taken over the past seven years, we now have answers for some of the 
issues which were identified from the COPED project of the 1960 f s. 
Here are thequestions posed earlier with some responses we can now 
make. 

1. Could effective training in interpersoaal skills and different 

kinds of problem solving be provided using packages of 

materials with designs conducted by non-experts? 

The answer is yes. At the Northwest Regional Educational Laboratory 

(NREL) we have developed the systems titled Interpersonal Communications, 

Interpersonal Influence, and a version of action research titled Research 

Utilizing Problem Solving. Evaluation during this development indicates 

trainees make significant gains on cognitive achievement, behavioral 

skills, and changes in attitudes. Follow up surveys indicate that gains 

are applied in schools. Those findings are reported in detalT in our 

33 

technical reports available from the NREL. The data further indicates 

that a high percentage of non-experts are likely to be kble to conduct 

successful workshops using these materials once familiar with a system. 

We collaborated with R. E. Corrigan Associates on adapting their version 

of system technology for teachers. This system, called System Approach 

for Educators, also provides significant gains. It was not, however, 

adapted to a degree where we were able to establish that non-experts can 

34 

De expected to successfully conduct workshops. We are well into 
creation of a system titled Social Conflict and Negotiative Problem Solvi 

20 



2. Could such an approach be made attractive enough in terms of 
interest and enjoyment in the training experience, 'and reason- 
able enough in terms of the cost in dollars and time t so that 
large numbers of educators would take this training? 
The answer is yes. Participants in final field tests rated the 
interpersonal systems very satisfying and worthwhile (92 percent for 
Interpersonal Communications and 97 percent for Interpersonal Influence) 
to a greater degree than the problem solving systems (76 percent for 
Research Utilizing Problem Solving: RUPS) . The lower ratings for the 
latter came principally from sites where participants had recently had 
positive experiences with open ended encounter group training and 
resisted the structure in the designs of our systems: We have also found 
evidence of resistance in sites where participants were directed to 
attend or where negative conflicts had been occurring in the schools. 
Under conditions of voluntary attendance, appropriate expectations and 
a non conflicted school setting, participants at RUPS workshops have also 
tended to respond positively above the 90 percent level. 

The workshops take about a week. Materials for a participant cost 
between $10.00 and $15.00 for Interpersonal Communications and Research 
Utilizing Problem Solving. We expect Interpersonal Influence and Social 
Conflict and Negotiative Problem Solving to be in this same range. 
Participant questionnaire responses indicate an overwhelmingly positive 
acceptance of these times and dollar costs. Sales and, reports of user 
sites indicate that widespread use of Interpersonal Communications and 
RUPS has begun since they became commercially available two years ago. 
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Sixteen thousand five hundred thirteen (16,513) sets of Interpersonal 
Communications have been sold. We are told that approximately 3,000 
teachers in Minneapolis have been through these systems. We are told 
that virtually all teachers in Duluth, Minnesota have been through RUPS. 
We know of workshops held in 30 states plus the district of Columbia 
and six foreign countries since development on these systems began. 
We are already experiencing a demand for our other systems prior to 
their completion. • 

3. Would those who provide and implement such training accept 
and use these training packages? Would they be acceptable 
for -credit by degree granting institutions? Would schools 
use them for inservice education? , 
Answers to the last two questions are definitely yes t For example, 
during the summer of 1974 we were told of 16 higher education institutions 
which offered 36 workshops using our systems. We suspect Others were not 
reported to us. Our systems are ustJd around the year for inservice 
training by school districts. Two higher education institutions are 
building advanced degree programs around our systems and others are 
considering this possibility. 

Answer to the first question is probably mixed and seems worthy of 
some careful study. We expect that our systems encounter an N.I.H. 
(Not-Invented Here) factor common to most educational innovations. 
We have had some indications of four phenomena in this regard. In some 
instances, our systems seem to be rejected because they represent 
competition with practices in which locar individuals have a vested 
self-interest. Our systems tend to need a capable advocate to gain a 

s 
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first try in a given site. Once tried, they generally create advocates 
and are repeated unless they arouse a competitive situation with 
superior opposing forces. 

A second phenomenon very likely includes a degree of competitiveness, 
bur gets dealt with by a process of adaptation. Instead of an outright 
rejection of our systems, they are tried in-toto, or partially, and then 
modified to fit the local situation. They have been broken down to fit 
the time constraints of college courses, simplified to satisfy* desires of 
administrators in the state where there is a claim that a briefer cognitive 
overview is .sufficient (our data suggest all potential gains are lost by 
such reductions), or some of the substantive focus is altered for greater 
relevance sach as in the case where a school ^district adapted RUPS around 
a focus on drug abuse issues for use with students. ^ 

A third phenomenon is suspected based on an independent study of the 
spread of RUPS conducted by the Far West Laboratory for Educational Research 
and Development. Their data indicated that the spread may be at least 
50 percent greater than commercial sales were showing. Since that 
particular system is already in the public domain, there are no legal 
problems in people reproducing it locally. We get indications that, 
despite our publishers maintaining quite reasonable prices, such local 
reproduction occurs for many of our systems. It may be that some 
resistance to our systems is simply a resistance to buying them, not 
to using them. 

A fourth phenomenon involves the sophistication of persons who do 
training and consulting and the ways they interpret their self-interests. 

#> 1 
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We think some reject trial of our systems because they believe any 

packaged training design will lack adequate relevance for their clients. 

We acknowledge that a design tailored for a particular client, or an 

instructional design that flows with issues as they emerge from the 

client, may have greater relevance. We believe our systems should be 

used with such other training alternatives. We think trainers who 

reject them with this concern are missing an important point.. The point 

is that our packaged designs can have added, complimentary advantages 

I. 

as related to tailored and unstructured training designs* Conditions 

for use of our systems, and expectable outcomes, are reasonably well 

known. The costs of training using our systems are comparatively low. 

Large numbers of people can receive training in a very short amount of 

time so that large system nortos may be inf luencable. -This spread does 

not demand many individuals with high level trainer capabilities. 

Our impressions on these phenomena are mainly subjective based on 

a variety of experiences. We propose they are worthy of some careful 

study. We, suspect they have major implications for large system change. 

4 Could such training resources be extended to increase the 

a 

number, of trainers with intermediary and advanced capabilities 
* for improving organizations? That is, could packaged training 
systems-Be developed to help in training trainers beyond the 
general systems for interpersonal skills and kinds of problem, 
solving? 

Our Work to date on ehe sequence of- three training systems titled 
Preparing Educational Training Consultants (PETC) indicates that answer 

\ » '4 

will be yes. A. degree of success may already be noted. 
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These three systems have the following foci. PETC I: Skirls 
Training is concerned with the use of skills training exercises to 
help individuals and groups function more effectively in such areas ' 
as goal setting, communicating, influencing ; and decision making. 
PETC II: Consultation provides the consultant wit* knowledge and 
skills to form temporary relationships with clients in order toftelp I ^ 
them add or strengthen functions needed to achieve a goal or clarify, - 
a value. PETC III: Organizational Development provides the consultant' 
with -knowledge and skills to aid a' client in building and maiftining 
increased functional capability when feasible and desired. 

The two interpersonal systems and three problem solving systems 
are proposed as prerequisites as .individuals move through the three 
PETC systems. At this stage of development, approximately 500 persons 
at sites spread across the country have begun this sequence. Tw hundred 
ten bave completed PETC II. Forty-nine have completed PETC III and two 

more groups are under way. 

Of the first 113 persons to complete PETC II, half were identified 
at random and contacted after their PETC II workshop to discover whether 
follow through consulting was occurring. Thirty eight percent reported ^ 
they had done some consulting prior -to their PETC II training. Fifty 
percent had had time to do consulting since their twining. Of those 
who had not, the principal Applanation, for not consulting was that their 
professional roles had chafed and/or did not provide opportunity to * 
do consulting. Those who had done consulting reported an average of 
about seven clients since- their PETC II workshop. AU but four percent 
of those who had been active were able to give numerous specific # 
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illustrations of gains from their PETC training' which they had been able 
to apRly with clients. 

Systems such as RUPS and Interpersonal Communications are providing 
a spread of one level of training which is involving many non-experts in 
conducting training. Even during development, we are*beginning to see 
the combination of systems, including the addition of the PETC's, moving 
more individuals toward higher levels of, trainership. In places^such as 
Minneapolis, Minnesota; Fairfax, Virginia'; Portland, Oregon; and Seattle, 
Washington, this is being done by training groups from the same system, 
as cadres of training consultants. In line with work such as that by 
Schmuck, Runkel, Saturen, Martell and Derr, 35 we suspect this to be a 
best strategy for use of our systems. 

5. Could a staff developing such training resources contribute 
to conceptualizing dynamic models that offered resolution 
of some of the disagreements' that were current? ' , 
We have offered several conceptualizations as we have created our 
training systems. Most of their content draws upon preexisting knowledge' 
and models. Some has been a synthesis resulting from our confrontation 
with apparent discrepancies and dilemmas. How valid and useful our 
additions may be remains for the most part, to be tested. We have seen 
our task >as developers primarily as one of finding ways to package ideas 
so that others may try them rather than one of testing ideas. 

Some of our major contributions to conceptualizing have included: 
1) a definition of three kinds of logical problem issues as technical, 
theoretical and philosophical which call, respectively, for either 
system technology, action researr • or negotiative types of problem solvin 
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2) a two dimensional model of "phases of platted change" as a sequence 
of emphasis of kinds of effort to be attended to repeatedly throughout 
a client relationship as opposed to their being conceived as a linear 
sequence of tasks; 

3) a three dimensional "diagnostic matrix" for considering the locus and 
nature of a clients functional deficiency at any given moment; 

4) a three dimensional "intervention matrix 11 for considering types of 
effort-which may contribute to facilitating a clients functional 
capabilities; 

5) a model of the development of the * social-psychological' self of 
individuals as a basis for defining the particularly demanding human 
aspects of educational systeiqe as organizations; 

6) an evolutionary model of the development of organizations which 
defines "organizational maturity" as distinct from "organizational 
growth," the former having to do with the forms and congruence' of key 
functional factors, and the latter having to do with existence and 
extent of functional capabilities necessary to fulfill the organizations 
purpose, whatever the characteristic manner in which they are provided. 
We have proposed that much of the success or failure of organizational 

development efforts may be based upon the appropriateness of change 

i , 
interventions in relation to an- organization s maturity. -y -> 

v 

We acknowledge that our conceptualizations may raise as many 
questions as they propose to resolve. Not believing in absolutes, we 
have offered these concepts supposing that an awareness of! questions can 
be at least as valuable as the presumption of an answer. Our training 
materials repeatedly emphasize the id£a that, in any particular case, 

27 
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the need of the Consultant and client is to discover w..at is true of 
their local situation. No theoretical moder or presumably generalizable 
research finding can substitute for that locally relevant truth. 
6. Could methodology be advanced, or found, to adequately 

evaluate efforts to develop training resources and train 

trainers? 

The challenge behind this question has seemed the most difficult 
to respond to. Under political pressure to "get out products" and 
sibling rivalry kinds of pressures to avoid stepping into the presumed 
domains of others roles, we have felt quite constrained in our roles' as 
developers over the years. There has been some greater feeling of 
freedom in the past two years since formation of the National Institute 
of Education and some efforts in. this area are being reposed at 
Session 13.11 of this AERA Annual Conference. If full support of work 
on instrumentation, and exploring of some research issues, were to be 
added as a combination with the kind of development we have been doing, 
we believe the payoff could be multiplied, providing such support in 
money and time will call for more courage and patience than, we have 
yet seen. 

Issues and Answers Yet To Be Resolved 

We know that the packages of training materials we have created 
have some significant effects, are generally acceptable and are already 
being widely used. We know they are beginning to be used in various 
local strategies. We had initially intended that the programatic effort 
p/ creating these training resources should be concluded with /a four year 
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longitudinal study of the combined effect of using them over time in two 
or three school districts. Our current f under does not intend to support 
such an effort. A great deal remains to be learned. 

In the context of various local strategies to improve school 
districts, what are the indications and contraindications for use of 
these packaged training systems in contrast to, or in relation with, 
other forms of training and consulting? What is the validity of .-.the 
developmental model of educational organizations we have put forth and 
what variables affect the predictive validity of its theorums? What 
reasons might there be for varying impacts resulting from use of the 
training systems? To the extent that change strategies using these 
systems have impact, will it be due to the substance of the training, 
the norms that develop around the process, or the linkages that form as 
implicit and explicit strategies unfold. 

Perhaps the biggett questions are when, whether and how resources 
may be brought together to carry out research at the level of organiza- 
tional functioning and improvement efforts? Such studies will cost 
millions of dollars and each take several years. Assuming that much is 
lost every day in the current functioning of educational organizations, 
it seems that an argument for major investment in research in this 
area can and should be made. 
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